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International application No. 
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Applicant's or agent's file reference 
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International filing date (day/month/year) 
06 April 2000 (06.04.00) 


Priority date (day/month/year) 

08 October 1999 (08.10.99) 


Applicant 

SATO, Yasushi 



1. The designated Office is hereby notified of its election made: 

| X| in the demand filed with the International Preliminary Examining Authority on: 

29 March 2001 (29.03.01) 



| ^ in a notice effecting later election filed with the International Bureau on: 



2. The election 



□ 



was not 



made before the expiration of 19 months from the priority date or, where Rule 32 applies, within the time limit under 
Rule 32.2(b). 



The International Bureau of WIPO 


Authorized officer 


34, chemin des Colombettes 


Maria Kirchner 


1211 Geneva 20, Switzerland 


Facsimile No.: (41-22) 740.14.35 


Telephone No.: (41-22) 338.83.38 



Form PCT/IB/331 (July 1992) 
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C py for the designated Office (DO/US) 
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From the INTERNATIONAL BUREAU 



PCT 

NOTIFICATION RELATING TO PRIORITY CLAIM 

(PCT Rules 26bis.1 and 26bis.2 and 
Administrative Instructions, Sections 402 and 409) 


To: 

UKABb, iviasao 

No. 602, Fuji Building 

2-3, Marunouchi 3-chome 

Chiyoda-ku, Tokyo 100-0005 

JAPON 


Date of mailing (day/month/year) 

14 June 2000(14.06.00) 


Applicant's or agent's file reference 
KW222PC 


IMPORTANT NOTIFICATION 


International application No. 
PCT/J POO/02237 


International filing date (day/month/year) 
06 April 2000 (06.04.00) 


Applicant 

KABUSHIKI KAISHA KENWOOD et al 



The applicant is hereby notified of the following in respect of the priority claim(s) made in the international application. 

1.(5?) Correction of priority claim. In accordance with the applicant's notice received on: 18 May 2000 (18.05.00), 
the following priority claim has been corrected to read as follows: 

JP 08 October 1999 (08.10.99) 1 1/288129 

I I even though the indication of the number of the earlier application is missing. 

I I even though the following indication in the priority claim is not the same as the corresponding indication appearing 
in the priority document: 



2. Q Addition of priority claim. In accordance with the applicant's notice received on: , 

the following priority claim has been added: 

"2 even though the indication of the number of the earlier application is missing. 
I | even though the following indication in the priority claim is not the same as the corresponding indication appearing 
in the priority document: 

3. | | As a result of the correction and/or addition of (a) priority claim(s) under items 1 and/or 2, the (earliest) priority date is: 

4. £3 Priority claim considered not to have been made. 

|~| The applicant failed to respond to the Invitation under Rule 26bis.2(a) (Form PCT/IB/3 16) within the prescribed time limit. 

PI The applicant's notice was received after the expiration of the prescribed time limit under Rule 26bis.1(a). 

I | The applicant's notice failed to correct the priority claim so as to comply with the requirements of Rule 4.1 0. 

The applicant may, before the technical preparations for international publication have been completed and subject to the 
payment of a fee, request the International Bureau to publish, together with the international application, information 
concerning the priority claim. See Rule 26bis.2(c) and the PCT Applicant's Guide, Volume I, Annex B2(IB). 

5. 1 I In case where multiple priorities have been claimed, the above item(s) relate to the following priority claim(s): 



6. A copy of this notification has been sent to the receiving Office and 
[3 to the International Searching Authority (where the international search report has not yet been issued). 
f%] the designated Offices (which have already been notified of the receipt of the record copy). 





The International Bureau of WIPO 
34, chemin des Colombettes 
1211 Geneva 20, Switzerland 

Facsimile No. (41-22) 740.14.35 


Authorized officer 

Y. KUWAHARA 

Telephone No. (41-22) 338.83.38 



Form PCT/IB/318 (July 1998) 003348519 
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PCT 

INTERNATIONAL PRELIMINARY EXAMINATION REPORT 

(PCT Article 36 and Rule 70) 



Applicant's or agent's file reference 


See Notification of Transmittal of International 


KW222PC 


FOR FURTHER ACTION Preliminary Examination Report {Form PCT/IPEA/416) 


International application No. 


International filing date (day/month/year) 


Priority date (day/month/year) 


PCT/J POO/02237 


06/04/2000 


08/10/1999 


International Patent Classification (IPC) or national classification and IPC 




H03H 17/06 






Applicant 






KABUSHIKI KAISHA KENWOOD et al. 





1. This international preliminary examination report has been prepared by this International Preliminary Examining Authority 
and is transmitted to the applicant according to Article 36. 

2. This REPORT consists of a total of 5 sheets; including this cover sheet. 

S This report is also accompanied by ANNEXES, i.e. sheets of the description, claims and/or drawings which have 
been amended and are the basis for this report and/or sheets containing rectifications made before this Authority 
(see Rule 70.16 and Section 607 of the Administrative Instructions under the PCT). 

These annexes consist of a total of 3 sheets. 



3. This report contains indications relating to the following items: 



I 


El 


II 


□ 


III 


□ 


IV 


□ 


V 




VI 


□ 


VII 


□ 


VIII 


□ 



citations and explanations suporting such statement 



Date of submission of the demand 
29/03/2001 



Date of completion of this report 
13.12.2001 



Name and mailing address of the international 
preliminary examining authority: 
European Patent Office 

D-80298 Munich 
_ Tel. +49 89 2399 - 0 Tx: 523656 epmu d 

Fax: +49 89 2399 - 4465 



Authorized officer 
Agerbaek, T 

Telephone No. +49 89 2399 8692 




Form PCT/I PEA/409 (cover sheet) (January 1994) 



INTERNATIONAL PRELIMINARY 
EXAMINATION REPORT 



International application No. PCT/ J POO/02237 



I. Basis of the report 

1 . With regard to the elements of the international application (Replacement sheets which have been furnished to 
the receiving Office in response to an invitation under Article 14 are referred to in this report as "originally filed" 
and are not annexed to this report since they do not contain amendments (Rules 70. 16 and 70.17)): 
Description, pages: 



1-53 



as originally filed 



Claims, No. 

1-10 



as received on 



11/10/2001 with letter of 



10/10/2001 



j Drawings, sheets: 

1/29-29/29 as originally filed 



2. With regard to the language, all the elements marked above were available or furnished to this Authority in the 
language in which the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language: , which is: 

□ the language of a translation furnished for the purposes of the international search (under Rule 23.1 (b)). 

□ the language of publication of the international application (under Rule 48.3(b)). 

□ the language of a translation furnished for the purposes of international preliminary examination (under Rule 
55.2 and/or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the 
international preliminary examination was carried out on the basis of the sequence listing: 

□ contained in the international application in written form. 

□ filed together with the international application in computer readable form. 

□ furnished subsequently to this Authority in written form. 

□ furnished subsequently to this Authority in computer readable form. 

□ The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in 
the international application as filed has been furnished. 

□ The statement that the information recorded in computer readable form is identical to the written sequence 
listing has been furnished. 

4. The amendments have resulted in the cancellation of: 

□ the description, pages: 

□ the claims, Nos.: 



Form PCT/IPEA/409 (Boxes l-VIII, Sheet 1) (July 1998) 



INTERNATIONAL PRELIMINARY 
EXAMINATION REPORT 



International application No. PCT/JP00/02237 



□ the drawings, sheets: 

5. □ This report has been established as if (some of) the amendments had not been made, since they have been 

considered to go beyond the disclosure as filed (Rule 70.2(c)): 

(Any replacement sheet containing such amendments must be referred to under item 1 and annexed to this 
report.) 

6. Additional observations, if necessary: 



V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 

1. Statement 



Novelty (N) 


Yes: 


Claims 


1-10 




No: 


Claims 


none 


Inventive step (IS) 


Yes: 


Claims 


1-10 




No: 


Claims 


none 


Industrial applicability (IA) 


Yes: 


Claims 


1-10 




No: 


Claims 


none 



2. Citations and explanations 
see separate sheet 



Form PCT/lPEA/409 (Boxes l-VIII, Sheet 2) (July 1998) 



• ■ I 

INTERNATIONAL PRELIMINARY International application No. PCT/JP00/02237 

EXAMINATION REPORT - SEPARATE SHEET 



Re Item I 

Basis of the report 

The examination is being carried out on the following application documents: 
Text for the Contracting States: 

AT BE CH DE DK ES Fl FR GB GR IT IE LI LU MC NL PT SE 
Description, pages: 

1 -53 as originally filed 

Claims, No.: 

1-10 as received on 1 1/10/2001 with letter of 10/10/2001 

Drawings, sheets: 

1/29-29/29 as originally filed 



1 . Reference is made to the following documents: 

D1 : EP-A-0 865 028 (LUCENT TECHNOLOGIES INC) 1 6 September 1 998 
(1998-09-16) 

D2: US-A-5 590 064 (ASTLE BRIAN) 31 December 1 996 (1 996-1 2-31 ) 
D3: EP-A-0 721 286 (MATSUSHITA ELECTRIC IND CO LTD) 10 July 1996 
(1996-07-10) 

Re Item V 

Reasoned statement under Article 35(2) with regard to novelty, inventive step or 
industrial applicability; citations and explanations supporting such statement 

2. Claims 1-10 are considered new and inventive over the prior art at hand: 
Independent method claim 1 and the corresponding device claim 6 define a 
method and device for processing a sampled and quantized input signal by 



Form PCT/Separate Sheet/409 (Sheet 1) (EPO-April 1997) 



INTERNATIONAL PRELIMINARY International application No. PCT/J POO/02237 

EXAMINATION REPORT - SEPARATE SHEET 



- determining interpolation object intervals (which are intervals where the input 
signal is a step function, ie has one value for a plurality of samples, and then 
jumps to another value for a plurality of samples), 

- detecting a degree of periodicity of a sequence of the input signal extending 
before, after, and covering the interpolation object interval, 

- interpolation processing the signal in the interpolation object interval according to 
a function curve that changes in response to the detected degree of periodicity. 

The result is a reduction in the quantization noise of the reconstructed data. 

D1-3 disclose similar methods, all in the context of reconstruction of data from a 
compressed representation. 

D1 (EP-A-0 865 028) is directed to decoding of speech signals from a two-signal 
frequency domain representation, using splines, but with no specific mention of 
means for reducing step artefacts, at least not as claimed. 
D2 and D3 are directed to decoding of compressed video signals, wherein the 
signals are coded as 2-D matrices corresponding to the discrete cosine transform 
DCT of eg 8 x 8 blocks of the original video data. 

D2 (US-A-5 590 064) is concerned with the artefacts that occur at the boundaries 
between adjacent inverse DCT decoded blocks. D2 has means for detecting 
whether a boundary discontinuity represents desired data or is due to artefacts, 
and means for adaptively filtering the adjacent blocks to remove an artefact. 
D3 (EP-A-0 721 286) is concerned with reducing edge artifacts resulting from step 
functions within a data block. D3 determines whether there is an edge within a 
block and if so, adaptively filters the edge to remove ringing. 
Although a rectangular step is shown in D3 Fig. 9, none of D2 and D3 has any 
mention or hint of determining intervals where a signal has the same value. 

Claims 1 , 6 and their dependent claims are therefore considered new and 
inventive, Art. 33(2) and (3) PCT. 

3. The application meets the requirements of the PCT with respect to industrial 
applicability, Art. 33(4) PCT, because the subject matter of claims 1-10 can be 
made or used in industry. 



Form PCT/Separate Sheet/409 (Sheet 2) (EPO-April 1997) 



11-10-2001 



JP0002237 



NEW CLAIMS 

1. A method for processing a digital signal that has a 
predetermined sampling cycle and quantization bit length, 
said method comprising the steps of: 

sequentially detecting signal intervals, where a plurality 
of same quantization levels continue; 

determining a predetermined signal interval, including 
a discontinuous part between two signal intervals adjacent to 
each other, as an interpolation object interval; 

detecting a degree of periodicity of a signal in an 
interval covering intervals before and after the interpolation 
object interval; and 

performing interpolation processing of signal levels in 
the interpolation object interval in accordance with a 
predetermined function curve with adaptively changing a 
change characteristic of the predetermined function curve 
that monotonously changes, on the basis of the degree of 
periodicity that is detected. 

2. The method according to claim 1, wherein the 
characteristic of the function curve change so that the 
function curve may gently change when the degree of the 
periodicity of a signal is large, and the function curve may 
sharply change if the degree is small. 

3. The method according to claim 1, wherein the step of 
performing interpolation processing includes a step of 
detecting the degree of periodicity of a signal by using 
frequency analysis. 

4. The method according to claim 1, wherein the step of 
performing interpolation processing includes a step of 
detecting the degree of periodicity of a signal by using 
auto-correlation function analysis. 

5. The method according to claim 3, comprising letting 
each of intervals where the plurality of same levels continue 
be an interpolation object interval-, and the frequency 



AMENDED SHEET 



60 



analysis measuring a level of a frequency component at a 
frequency f = 1/2T vyhere T is a time length of the 
interpolation object interval. 

6. An apparatus for processing a digital signal that has a 
predetermined sampling cycle and quantization bit length, 
said apparatus comprising: 

means for sequentially detecting signal intervals, 
where a plurality of same levels continue; 

means for determining a predetermined signal interval, 
including a discontinuous part between signal intervals, 
which are adjacent to each other and in which the same 
levels continue, as an interpolation object interval; 

means for detecting a degree of periodicity of a signal 
in a interval covering intervals before and after the 
interpolation object interval; and 

means for performing interpolation processing of signal 
levels in the interpolation object interval in accordance with a 
predetermined function curve, which monotonously changes, 
by adaptively changing a change characteristic of the 
function curve, on the basis of the degree of periodicity that 
is detected. 

7. The apparatus according to claim 6, wherein the 
interpolation means makes a characteristic of the function 
curve change so that the function curve may gently change 
when the degree of the periodicity of a signal is large, and 
the function curve may sharply change when the degree is 
small. 

8. The apparatus according to claim 6, wherein the 
means for performing interpolation processing operates so 
as to detect the degree of periodicity of a signal by using 
frequency analysis. 

9. The apparatus according to claim 6, wherein the 
means for performing interpolation processing operates so 
as to detect the degree of periodicity of a signal by using 
auto-correlation function analysis. 



AMENDED SHEET 



10. The apparatus according to claim 8* comprising letting 
each of intervals where the same levels continue be an 
interpolation object interval, and the frequency analysis 
measuring a level of a frequency component at a frequency f 
= 1/2T where T is a time length of the interpolation object 
interval. 
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To: 

ASAHI, Nobumitsu 

OKABE INTERNATIONAL PATENT OFFICE 

No. 602 Fuji Bldg. 2-3, 

Marunouchi 3-chome Chiyoda-ku 

Tokyo 100-0005 

JAPON 


ft) 1,7. 27 J 


PCT 

WRITTEN OPINION 
(PCT Rule 66) 






Date of mailing 
(day/month/year) 


24.07.2001 


Applicant's or agent's file reference 


REPLY DUE 


within 3 month(s) 

from the above date of mailing 


KW222PC 





International application No. 
PCT/JP00/02237 



International filing date (day/month/year) 
06/04/2000 



Priority date (day/month/year) 
08/10/1999 



International Patent Classification (IPC) or both national classification and IPC 
H03H 17/06 



Applicant 

KABUSHIKI KAISHA KENWOOD et al. 



This written opinion is the first drawn up by this International Preliminary Examining Authority. 
This opinion contains indications relating to the following items: 



Non-establishment of opinion with regard to novelty, inventive step and industrial applicability 
Lack of unity of invention 

Reasoned statement under Rule 66.2(a)(ii) with regard to novelty, inventive step or industrial a 
citations and explanations supporting such statement 



I 




II 


□ 


III 




IV 


□ 


V 


□ 


VI 


□ 


VII 


□ 


VIII 


□ 



3. 



4. 



The applicant is hereby invited to reply to this opinion. 

When? See the time limit indicated above. The applicant may, before the expiration of that time limit, 
request this Authority to grant an extension, see Rule 66.2(d). 

How? By submitting a written reply, accompanied, where appropriate, by amendments, according to Rule 66.3. 

For the form and the language of the amendments, see Rules 66.8 and 66.9. 

Also: For an additional opportunity to submit amendments, see Rule 66.4. 

For the examiner's obligation to consider amendments and/or arguments, see Rule 66.4 bis. 
For an informal communication with the examiner, see Rule 66.6. 

If no reply is filed, the international preliminary examination report will be established on the basis of this opinion. 

The final date by which the international preliminary 

examination report must be established according to Rule 69.2 is: 08/02/2002. 



Name and mailing address of the international 
preliminary examining authority: 

J- European Patent Office 
D-80298 Munich 
Tel. +49 89 2399 - 0 Tx: 523656 epmu d 
Fax: +49 89 2399 - 4465 



Authorized officer / Examiner 
Agerbaek, T 



Formalities officer (incl. extension of time limits) 
Rdhner, M 

Telephone No. +49 89 2399 2294 
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International application No. PCT/JP00/02237 



I. Basis of the opinion 

1. With regard to the elements of the international application (Replacement sheets which have been furnished to 
the receiving Office in response to an invitation under Article 14 are referred to in this opinion as "originally filed"): 

Description, pages: 

1 -53 as originally filed 

Ciaims, No.: 

1 -56 as originally filed 

Drawings, sheets: 

1/29-29/29 as originally filed 

2. With regard to the language, all the elements marked above were available or furnished to this Authority in the 
language in which the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language: , which is: 

□ the language of a translation furnished for the purposes of the international search (under Rule 23.1 (b)). 

□ the language of publication of the international application (under Rule 48.3(b)). 

□ the language of a translation furnished for the purposes of international preliminary examination (under Rule 
55.2 and/or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the 
international preliminary examination was carried out on the basis of the sequence listing: 

□ contained in the international application in written form. 

□ filed together with the international application in computer readable form. 

□ furnished subsequently to this Authority in written form. 

□ furnished subsequently to this Authority in computer readable form. 

□ The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in 
the international application as filed has been furnished. 

□ The statement that the information recorded in computer readable form is identical to the written sequence 
listing has been furnished. 

4. The amendments have resulted in the cancellation of: 

□ the description, pages: 

□ the claims, Nos.: 
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□ the drawings, sheets: 

5. □ This report has been established as if (some of) the amendments had not been made, since they have been 

considered to go beyond the disclosure as filed (Rule 70.2(c)): 

(Any replacement sheet containing such amendments must be referred to under item 1 and annexed to this 
report.) 

6. Additional observations, if necessary: 

III. Non-establishment of opinion with regard to novelty, inventive step and industrial applicability 

} 1. The questions whether the claimed invention appears to be novel, to involve an inventive step (to be non- 
obvious), or to be industrially applicable have not been and will not be examined in respect of: 

H the entire international application, 

□ claims Nos. , 

because: 

□ the said international application, or the said claims Nos. relate to the following subject matter which does 
not require an international preliminary examination (specif}/): 

IS the description, claims or drawings (indicate particular elements beloW) or said claims Nos. are so unclear 
that no meaningful opinion could be formed (specify): 
see separate sheet 

□ the claims, or said claims Nos. are so inadequately supported by the description that no meaningful opinion 
could be formed. 

□ no international search report has been established for the said claims Nos. . 

2. A written opinion cannot be drawn due to the failure of the nucleotide and/or amino acid sequence listing to 
comply with the standard provided for in Annex C of the Administrative Instructions: 

□ the written form has not been furnished or does not comply with the standard. 

□ the computer readable form has not been furnished or does not comply with the standard. 
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Re Item I 

Basis of the opinion 

The examination is being carried out on the following application documents: 
Text for the Contracting States: 

AT BE CH DE DK ES Fl FR GB GR IT IE LI LU MC NL PT SE 
Description, pages: 

1 -53 as originally filed 

) 

Claims, No.: 

1 -56 as originally filed 

Drawings, sheets: 

1/29-29/29 as originally filed 

Re Item III 

Non-establishment of opinion with regard to novelty, inventive step and 
industrial applicability 

1 . No opinion will be given on any of the filed claims, for the following reasons: 

a) Although claims 1, 25, 43 (method) and 13, 34, 50 (device) have been drafted as 
separate independent claims, they appear to relate effectively to the same subject- 
matter and to differ from each other only with regard to the definition of the subject- 
matter for which protection is sought and/or in respect of the terminology used for the 
features of that subject-matter. The aforementioned claims therefore lack conciseness. 
Moreover, lack of clarity of the claims as a whole arises, since the plurality of in- 
dependent claims makes it difficult, if not impossible, to determine the matter for which 
protection is sought, and places an undue burden on others seeking to establish the 
extent of the protection. 

Hence, the set of claims does not meet the conciseness requirements of Article 6 PCT. 
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b) Taken individually, the claims are very unclear: 

With respect to claim 1 , for example, even with the best intentions, examiner cannot 
find a single interpretation of the claim that makes sense: 

- it is unclear what 'interpolation of signal levels' is (lines 5-6), 

- it is unclear what 'an interpolation object', or 'an interpolation object interval' is (line 6), 

- it is unclear what it is that '[includes] a discontinuous part', (line 9), 

- it is unclear what the 'discontinuous part' is a part of, (line 9), 

- the passage of lines 10-13 starting with 'where the same levels continue' is 
semantically a contradiction in terms, ie 'the same level different from them' (how can 
the same level be different, and what are 'them' ?) 

These are merely examples of isolated unclarities. Taken as a whole, claim 1 is fully 
unclear, Art. 6 PCT. The other independent claims have not been examined, but at 
glance seem to exhibit at least some of the unclarities of claim 1. 

c) Because of the abovementioned lack of clarity, it has not been possible to determine 
whether the requisite unity of invention (Rule 13.1 PCT) exists. 

2. The applicant is invited to file a new set of claims overcoming the above objections. 
More specifically, the claims need substantial clarification. Further, in case the applicant 
wishes to maintain more than a single independent claim in each category, examiner 
would appreciate an indication of what the single inventive concept linking the claims is, 
and why a single independent claim based on this concept could not be drafted that 
would encompass the combined scope of the filed multiple independent claims. 
The applicant is reminded not to introduce subject matter which extends beyond the 
content of the application as filed, Article 34(2)(b) PCT. In any case, examiner would 
appreciate an indication of the basis of any amendments made, regardless of their 
nature. 
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(57) Abstract: The present invention relates to an interpolation method and an interpolation apparatus for a digital audio signal 
or a digital image signal that has a predetermined sampling cycle and quantization bit length, and in particular, to an interpolation 
method and an interpolation apparatus that can effectively reduce quantization noise in a digital signal that is obtained by information 
compression. In the method and apparatus according to the present invention, it is made to perform interpolation processing of 
signal levels in an interpolation object interval in a given digital signal in accordance with a predetermined function curve, which 
monotonously changes, with the interpolation object interval including a discontinuous part that exists between one signal interval, 
where the same gradation levels continue, and another signal interval, which is adjacent to the one signal interval and in which the 
same gradation levels that are different continue. The interpolation processing according to the present invention is performed by 
making a change characteristic of a function curve adaptively change in accordance with a degree of periodicity of a signal in an 
interval covering intervals before and after the interpolation object interval. 
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Description 

Method and Apparatus for Interpolating Digital Signal 

Technical Field 

The present invention relates to an interpolation 
method and an interpolation apparatus for a digital signal, 
and in particular, to an interpolation method and an 
interpolation apparatus that can effectively reduce 
quantization noise even in a digital signal having large 
quantization noise like a case of decompressing compressed 
data. 

Background Art 

For example, in the digital recording/playback of 
audio, video, or the like, original audio, video, or the like 
are reproduced by recording a digital signal (a series of 
sampled and quantized levels) in a predetermined recording 
medium such as semiconductor memory, and an optical 
disk through A/D conversion of analog signals of the audio, 
video, or the like, and performing the D/A conversion of the 
digital signal after reading the digital signal from the 
recording medium when playing back. If it is desired to 
save the capacity of the recording medium, it can be 
performed to shorten quantization bit length when 
performing the A/D conversion of the analog signals, but 
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quantization noise arises in the digital signal read from the 
recording medium. For this reason, interpolation 
processing is performed by not only expanding the 
quantization bit length of the digital signal, read from the 
recording medium, by the predetermined bit length toward 
a low-order side, but also inputting the digital signal to a 
variable low pass filter whose frequency characteristic 
(cutoff frequency) dynamically changes according to an 
input waveform as shown in FIG. 22. 

For example, if an original signal is a sinusoidal 
analog signal as shown in FIG. 23(1), a digital signal after 
A/D conversion is as shown in FIG. 23(2), but a digital 
signal the interpolation processing of which is performed by 
being inputted into a variable low pass filter after bit 
expansion is as shown in FIG. 23(3), the digital signal is 
near to the original sinusoidal wave, and hence, it can be 
seen that quantization noise is considerably improved. 

Disclosure of Invention 

If a comparatively expensive recording medium such 
as semiconductor memory is used, it is made to store a 
digital signal after compressing the digital signal so as to 
further effectively use memory capacity. If such an 
irreversible compression method that has a high 
compressibility but cannot completely restore a waveform 
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to its original waveform is used, for example, if the original 
signal is a sinusoidal wave as shown in FIG. 23(1), an 
original digital signal after A/D conversion becomes as 
shown in FIG. 23(2), and hence quantization noise is not so 
s large yet, but a restored digital signal after compression 
and decompression becomes as shown in FIG. 24(1), and 
hence large quantization noise is left. If this restored 
digital signal is inputted into a variable low pass filter after 
the quantization bit length of this restored digital signal is 
10 expanded by predetermined bit length toward a low-order 
side, this restored digital signal becomes as shown in FIG. 
24(2), and hence the large quantization noise is left yet. 
There is such a problem that, if it is attempted to make a 
cutoff characteristic of the variable low pass filter sharp so 
is as to increase an effect of quantization noise reduction, it 
is not possible to realize the desire since a group delay 
frequency characteristic becomes worse. 

In consideration of the problems of the conventional 
art described above, an object of the present invention is to 
20 provide an interpolation method and an interpolation 
apparatus that can reduce the quantization noise without 
deteriorating the group delay frequency characteristic. 

The present invention is characterized in that, in a 
method or an apparatus for processing a digital audio 
2 5 signal or a digital image signal that has a predetermined 
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sampling cycle and quantization bit length, the present 
invention performs interpolation processing of signal levels 
within an interpolation object interval in accordance with a 
predetermined function curve, which monotonously 
5 changes, with the interpolation object interval, including a 
discontinuous part, which exists between one signal 
interval, where the same levels continue, and another 
signal interval, which is adjacent to the one signal interval 
and in which the same levels that are different from the 
10 former same level, continue. 

A digital signal that is an object of the interpolation 
processing is a series of quantized amplitude values of an 
audio signal in case of the digital audio signal, and a series 
of quantized gradation values or a series of quantized 
is two-dimensional frequency conversion coefficient values of 
an image signal in case of a digital image signal. 

The interpolation processing of the present invention 
is performed by making a change characteristic of a 
function curve adaptively change in accordance with a 
20 degree of the periodicity of a signal in an interval covering 
intervals before and after the interpolation object interval. 
Then, the interpolation processing makes the characteristic 
of the function curve change so that the function curve 
may gently change if the degree of the periodicity of the 
2 5 signal is large, and the function curve may sharply change 
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if the degree is small. In addition, the degree of the 
periodicity is detected by using frequency analysis or 
auto-correlation analysis. 

Preferably, with letting time length within the 
5 interpolation object interval be T, the function curve is 
made to be adaptively changed according to a level of a 
frequency component at a frequency f = 1/2T. 

In addition, as the interpolation object interval, any 
one kind of interval is selected from among three kinds of 

10 intervals such as (i) an interval whose starting point is a 
start of a preceding same level continuation interval and 
whose end point is a start of a succeeding same level 
continuation interval, (ii) an interval whose starting point 
is an end of a preceding same level continuation interval 

is and whose end point is an end of a succeeding same level 
continuation interval, and (iii) an interval whose starting 
point is a nearly median point of a preceding same level 
continuation interval and whose end point is a nearly 
median point of a succeeding same level continuation 

20 interval. 

Furthermore, if a digital image signal is processed in 
the present invention, not only in the horizontal direction 
of a frame screen, the present invention makes gradation 
levels smoothly change along the horizontal direction by 
25 performing the interpolation processing in accordance with 
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a predetermined function curve in a predetermined signal 
interval including a discontinuous part that exists between 
one signal interval, where the same gradation levels 
continue, and one signal interval, which is adjacent to the 
one signal interval and in which the same gradation levels 
that are different from the former continue, but also in the 
vertical direction of the frame screen, the present invention 
makes gradation levels smoothly change along the vertical 
direction by performing the interpolation processing in 
accordance with a predetermined function curve in a 
predetermined signal interval including a discontinuous 
part that exists between one signal interval, where the 
same gradation levels continue, and another signal interval, 
which is adjacent to the one signal interval and in which 
the same gradation levels that are different from the former 
continue. This corresponds to a case of processing a static 
image signal. 

If a dynamic image signal is processed, in addition to 
this, in the interframe direction, the present invention 
makes gradation levels smoothly change along the 
interframe direction by performing the interpolation 
processing in accordance with a predetermined function 
curve in a predetermined signal interval including a 
discontinuous part that exists between one signal interval, 
where the same gradation levels continue, and another 
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signal interval, which is adjacent to the one signal interval 
and in which the same gradation levels that are different 
from the former continue. 

In addition, the above-described method for processing 
5 a digital image signal includes a process of transforming a 
series of gradation levels in the horizontal direction into a 
series of gradation levels in the vertical direction after the 
step of performing the interpolation processing in the 
horizontal direction, a process of transforming a series of 

10 gradation levels in the vertical direction into a series of 
gradation levels in the interframe direction after the step of 
performing the interpolation processing in the vertical 
direction, and a process of transforming a series of 
gradation levels in the interframe direction into a series of 

15 gradation levels in the horizontal direction after the step of 
performing the interpolation processing in the interframe 
direction. 

Then, the transformation of the series of gradation 
levels is performed by the reading/ writing operation of 
20 frame memory, and preferably, with letting N be a natural 
number, the series of gradation levels is transformed by 
providing two image memories each having N frames of 
capacity and repeating reading and writing operation 
alternately. 

25 
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Brief Description of the Drawings 

FIG. 1 is a block diagram showing a configuration of 
an interpolation apparatus according to an embodiment of 
the present invention; 

FIG. 2 is a frequency spectral map showing a result of 
FFT processing that a DSP (Digital Signal Processor) in FIG. 
1 performs; 

FIG. 3 is a flow chart showing the main processing of 
the DSP (Digital Signal Processor) in FIG. 1; 

FIG. 4 is a flow chart showing the main processing of 
the DSP in FIG. 1; 

FIG. 5 is a flow chart showing the FFT processing of 

the DSP in FIG. 1; 

FIG. 6 is a flow chart showing the data input 
s processing of the DSP in FIG. 1; 

FIG. 7 is a flow chart showing the data output 
processing of the DSP in FIG. 1; 

FIG. 8 is explanatory diagrams showing the FFT 
operation of the DSP in FIG. 1; 
a FIG. 9 is diagrams showing an embodiment of 

interpolating operation by a curve; 

FIG. 10 is explanatory diagrams showing the 
interpolating operation of the DSP in FIG. 1; 

FIG. 11 is diagrams for explaining interpolation 
s functions; 
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FIG. 12 is diagrams showing interpolating operation 
by an interpolation apparatus; 

FIG. 13 is a diagram showing interpolating operation 
by the interpolation apparatus in FIG. 1; 
5 FIG. 14 is a flow chart showing the main processing of 

the DSP according to an example modified from that in FIG. 

i; 

FIG. 15 is a flow chart showing the main processing of 
the DSP according to another example modified from that 

10 in FIG. 1; 

FIG. 16 is diagrams showing another embodiment of 

interpolating operation by a curve; 

FIG. 17 is a flow chart showing the main processing of 
the DSP according to still another example modified from 

is that in FIG. 1; 

FIG. 18 is a flow chart showing the main processing of 
the DSP according to a still further example modified from 

that in FIG. 1; 

FIG. 19 is diagrams showing an embodiment of 
20 interpolating operation by a straight line; 

FIG. 20 is a flow chart showing the main processing of 
the DSP according to another example modified from that 
in FIG. 1; 

FIG. 21 is diagrams showing another embodiment of 
25 interpolating operation by a straight line; 
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FIG. 22 is a graph showing frequency characteristics 
of a conventional variable low pass filter; 

FIG. 23 is diagrams for explaining the interpolating 
operation of a conventional variable low pass filter style; 
5 FIG. 24 is diagrams for explaining the interpolating 

operation of a conventional variable low pass filter style; 

FIG. 25 is a graph showing the structure of image 
frames; 

FIG. 26 is fundamental block diagrams showing the 
10 preliminary treatment and interpolation processing of a 
digital image signal; 

FIG. 27 is conceptual diagrams of the transforming of 

a series of pixels in FIG. 26; 

FIG. 28 is a concrete circuit diagram of a 
is series-of-pixels transducer in FIG. 26 as an embodiment; 

FIG. 29 is timing charts showing the operation of the 

circuit in FIG. 28; and 

FIG. 30 is drawings showing a transversal filter 
executing the two-dimensional interpolation processing of 

20 an image signal. 

Best Mode for Carrying Out t he Invention 
Fundamental consideration 

First, the fundamental consideration of interpolation 
processing algorithm for a digital signal according to the 
25 present invention will be described. 
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Since plenty of source signals such as music have 
periodicity, a line spectrum is observed at each of several 
frequencies by analyzing frequency components by FFT in 
some time window and viewing a frequency spectrum. In 
5 addition, in a digital signal, having large quantization noise, 
such as a digital music signal, intervals where the same 
quantization levels continue (hereinafter, the same value 
continuation intervals) periodically appear frequently. 

Generally speaking, it is known that it is possible to 
10 perform coding of an original analog signal in the bit length 
shorter than that in a linear PCM system by performing 
digital information compression of an audio or image signal 
by differential PCM (DPCM), adaptive differential PCM 
(ADPCM), or subband ADPCM, and to communicate or 
15 record the signal. Nevertheless, since the digital signal 
represented in short bit length has large quantization step 
size, a part that stepwise changes arises if same value 
continuation intervals that have different values from each 
other adjoin to each other (see FIG. 9(2)). If an original 
20 waveform smoothly changes basically in such intervals, 
quantization noise arises by this step being decoded as it is. 
Then, in order to effectively reduce the quantization noise, 
if it is estimated that the original waveform smoothly 
changes, the present invention processes the stepped part 
25 so that the stepped part may smoothly change by 
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performing level interpolation of the stepped part of the 
digital signal, which is formed by the same value 
continuation intervals. On the other hand, if the original 
waveform sharply changes basically (for example, a pulsed 
music waveform), the present invention dares not perform 
the interpolation processing. Since it is considered that a 
usual signal waveform has a characteristic between these 
waveform characteristics, the present invention adaptively 
performs the interpolation processing according to a 
waveform characteristic estimated. When the 

characteristic of the original waveform is estimated, the 
present invention detects a degree of the periodicity, noise 
characteristics, impulse characteristics, or the like of the 
original waveform by analyzing a time interval (see FIG. 8), 
5 which is widish and includes the intervals before and after 
a interpolation object interval (including the stepped part 
changing between the same value continuation intervals 
that adjoin to each other), by using frequency analysis and 
auto-correlation analysis. 

o 

Embodiments of the present invention 

The present invention can reduce quantization noise 
with preventing some frequency component from being 
remarkably emphasized from the viewpoint of frequency 
5 components that an original series of digital data has 
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before and after a first same value continuation interval by 
detecting a part where two same value continuation 
intervals, whose values are different from each other in the 
series of digital data, appear in succession, and performing 
5 interpolation according to an interpolation function almost 
monotonously changing from the start of an interpolation 
object interval to the start of a second same value 
continuation interval with all or part of an interval, 
preceding just before the second same value continuation 
10 interval, in the first same value continuation interval as 
the interpolation object interval. Thus, by analyzing 
frequency components that the series of digital data has in 
a predetermined interval also covering intervals before and 
after the first same value continuation interval and 
is adaptively changing an interpolation function according to 
the result of the frequency component analysis, it becomes 
possible to perform such advanced interpolation that the 
reduction of the quantization noise is preferentially 
performed if there is a small possibility of some frequency 
20 component being especially emphasized from the viewpoint 
of frequency components that the original series of digital 
data has in the interval covering intervals before and after 
the first same value continuation interval even if 
quantization noise is extensively reduced, and the 
25 reduction of the quantization noise is performed as far as 
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some frequency component is not excessively emphasized if 
there is a large possibility of the frequency component 
being remarkably emphasized by attempting to extensively 
reduce the quantization noise. 
5 With letting the time length of the interpolation object 

interval be T, a component having a frequency f = 1/2T is 
easily emphasized by an interpolation waveform. Then, by 
adaptively changing the interpolation function according to 
the amplitude of the component with the frequency f = 1/2T 
10 that the series of digital data before the interpolation has 
in the predetermined interval covering the intervals before 
and after the first same value continuation interval, it 
becomes possible to preferentially perform the reduction of 
the quantization noise if there is a small possibility of the 
15 component with the frequency f = 1/2T being especially 
emphasized even if quantization noise is extensively 
reduced, and to perform the reduction of the quantization 
noise as far as the frequency component is not excessively 
emphasized if there is a large possibility of the component 
20 with the frequency f = 1/2T being remarkably emphasized 
by attempting to extensively reduce the quantization noise. 

By adapting an interpolation waveform in the 
interpolation object interval to the frequency components 
that a signal waveform of the series of digital data before 
25 the interpolation has in a predetermined interval also 
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covering intervals before and after the first same value 
continuation interval, it becomes possible to reduce the 
quantization noise with preventing a frequency component 
from being especially emphasized from the viewpoint of 
frequency components that the original series of digital 
data has. Here, "To adapt an interpolation waveform in 
the interpolation object interval to the frequency 
components that a signal waveform of the series of digital 
data before the interpolation has in a predetermined 
interval also covering intervals before and after the first 
same value continuation interval" means to perform 
processing lest needless frequency components should be 
preferably added by making respective spectrum 
frequencies of frequency components added by an 
5 interpolation waveform overlap, as much as possible, all or 
part of respective spectrum frequencies by the frequency 
component that the series of digital data before the 
interpolation has in the predetermined interval covering the 
intervals before and after the first same value continuation 
o interval, and more preferably, means to prevent a frequency 
component from being excessively emphasized, the 
frequency component added by an interpolation waveform 
being included in frequency components that the signal 
waveform of the series of digital data before the 
5 interpolation has in the predetermined interval covering the 
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intervals before and after the first same value continuation 
interval. 

Interpolation processing of the present invention 
changes an interpolation function that adaptively 
5 determines an interpolation waveform according to the 
result of frequency component analysis by FFT of a series 
of digital data before the interpolation in a predetermined 
interval covering the intervals before and after the first 
same value continuation interval, and lets the time length 
10 of the interpolation object interval be T, lets an amplitude 
value of a frequency 1/2T = f s /2L 2 be q a , lets the relative 
length of its spectrum be r a , lets an amplitude value of a 
frequency f ma x whose amplitude value is the largest be q m ax, 
and lets the relative length of its spectrum be r ma x. Here, 
15 as an example, an interpolation function is adaptively 
changed according to the relative amplitude of r a to Rm. 

Concretely, a normalized first function Fi(x) is defined 
as follows: 

Fi(x) = (1/2) - (l/2)»cos(x7t/2) 
20 where x = 0, 2. 

The function Fi(x) is shown in FIG. 11(1), the function 
Fi(x) which sinusoidally and monotonously increases from 
0 to 1 within a range of x = 0, 2. 

Further, a normalized second function F2(x) is defined 
25 as follows: 
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if Ra * Rm, 

F 2 (x) = 1 - {1 - (r a /RM)}»{l - (x - l) 2 }" 2 
or, if r a = Rm, 
F 2 (x) = 1 

where x = 0, 2. The function F 2 (x) is shown in FIG. 
11(2), the function F 2 (x) which changes along an elliptical 
curve within a range from the minimum value = 1 - {1 - 
(r a /R„)} to the maximum value = 1 within a range of x = 
0, 2 (if r a * Rm), or has a constant value, that is, 1 
within the range of x = 0, 2 (if r a = Rm). 

A function G(x) is defined as follows: 

G(x) = Fi(x)«F 2 (x) 

where x = 0, 2, 

and an interpolation function Y(Si + j) that adaptively 
changes according to the relative amplitude of r a to Rm is 
defined as follows (j is a discrete variable; Si + j expresses 
an address of first memory 2A): 

Y(Si + j) = Yi + (Y 2 - Yi)«G(2j/L 2 ) 
where j = 1, 2, (L 2 - 1). 
> For example, if r a = Rm , F 2 (x) = 1, and hence G(x) = 

Fi(x). Therefore, digital signals in the interpolation object 
interval are interpolated by a sinusoidal waveform having a 
frequency of f s /2L 2 so as to monotonously increase from 
the start of the interpolation object interval to the start of 
5 the second same value continuation interval (see an 
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interpolation curve A and interpolation data D3.1, Di.i, and 
D 5 ,i in FIG. 10(1)). At this time, the quantization noise is 
drastically reduced. Since a frequency component with 
f s /2L 2 that has large value exists from the beginning with 
viewing it in a predetermined interval before and after 
including the first same value continuation interval out of 
the original series of digital data if r a = Rm, grating noise is 
never created even if this interpolation object interval is 
interpolated with the sinusoidal waveform with the 
frequency of f s /2L 2 . 

In addition, if r a = Rm/2, digital signals in the 
interpolation object interval are interpolated along a 
waveform curve that is created by a little crushing the 
sinusoidal waveform with the frequency of f s /2L 2 in the 
5 direction of approaching to the original shapes of the first 
same value continuation interval and second same value 
continuation interval (see an interpolation curve B and 
interpolation data D 3 ,2, D 4>2 , D5.2 in FIG. 10(1)). At this 
time, although the reduction of the quantization noise is a 
0 little small, it is possible to prevent the grating noise from 
being emphasized by the interpolation waveform since the 
frequency component with f s /2L 2 is not large with viewing 
it in a predetermined interval before and after including the 
first same value continuation interval out of an input series 
5 of digital data. 
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On the other hand, for example, if r a = Rm , F 2 (x) - 1, 
and hence G(x) = Fi(x). Therefore, digital signals in the 
interpolation object interval are interpolated by a 
sinusoidal waveform having a frequency of f s /2Li so as to 
5 monotonously increase from the start of the interpolation 
object interval to the start of the second same value 
continuation interval (see an interpolation curve C and 
interpolation data D 7 ,i, D 8( i, and Dg.i in FIG. 10(2)). At 
this time, the quantization noise is drastically reduced. 
io Since a frequency component with f s /2Li that has a large 
value exists from the beginning with viewing it in a 
predetermined interval before and after including the first 
same value continuation interval out of the input series of 
digital data if r a = Rm, grating noise is never created even if 
is this interpolation object interval is interpolated with the 
sinusoidal waveform with the frequency of f s /2Li. 

In addition, if r a = Rm/2, digital signals in the 
interpolation object interval are interpolated along a 
waveform curve that is created by a little crushing the 
20 sinusoidal waveform with the frequency of f s /2Li (see an 
interpolation curve D and interpolation data D7.2, Ds,2, D<j,2 
in FIG. 10(2)). At this time, although the reduction of the 
quantization noise is a little small, it is possible to prevent 
grating noise from being emphasized by the interpolation 
25 waveform since the frequency component with f s /2Li is not 
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large with viewing it in the predetermined interval before 
and after including the first same value continuation 
interval out of an input series of digital data. 

Although the function expressing half-wave length of 
sinusoidal curve is selected as an interpolation function in 
the embodiment described above, the present invention is 
not limited to this, but, for example, a function expressing 
quarter-wave length of sinusoidal curve can also be 
selected. In this case, with paying attention to a 
component with f = 1/4T in the result of FFT analysis, 
similar processing is performed. Furthermore, another 
monotone increasing or monotone decreasing function can 
also be used as the interpolation function. 

As described above, by analyzing frequency 
components that the series of digital data before 
interpolation has in a predetermined interval also covering 
intervals before and after the first same value continuation 
interval and adaptively changing an interpolation function 
according to the result of the frequency component analysis, 
o the present invention preferentially performs reduction of 
the quantization noise if there is a small possibility of a 
frequency component being especially emphasized from the 
viewpoint of frequency components that the series of 
digital data before interpolation has before and after the 
5 first same value continuation interval even if quantization 
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noise is extensively reduced, and performs the reduction of 
the quantization noise as far as a frequency component is 
not excessively emphasized if there is a large possibility of 
the frequency component being remarkably emphasized by 
attempting to extensively reduce the quantization noise. 

Concretely, with letting the time length of the 
interpolation object interval be T, a component having a 
frequency f = 1/2T is easily emphasized by an interpolation 
waveform. Then, by adaptively changing the interpolation 
function according to the amplitude of the component with 
the frequency f = 1/2T that the series of digital data before 
the interpolation has in the predetermined interval covering 
the intervals before and after the first same value 
continuation interval, it becomes possible to preferentially 
perform the reduction of the quantization noise if there is a 
small possibility of the component with the frequency f = 
1/2T being especially emphasized even if quantization 
noise is extensively reduced, and to perform the reduction 
of the quantization noise as far as the frequency f = 1/2T is 
not excessively emphasized if there is a large possibility of 
the component with the frequency f = 1/2T being 
remarkably emphasized and a feeling of strangeness in 
auditory sensation arises by attempting to extensively 
reduce the quantization noise. 
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In consequence, for example, if an input series of 
digital data is as shown in FIG. 12(1), an output of an 
interpolation apparatus according to this embodiment is as 
shown in FIG. 12(2), and hence it can be seen that the 
5 quantization noise is drastically reduced. In addition, if 
an input series of digital data is as shown in FIG. 20(1), an 
output of the interpolation apparatus according to the 
present invention is as shown in FIG. 13, and hence it can 
be seen that it is possible to suppress the quantization 

10 noise in comparison with a case of using a conventional low 
pass filter (see FIG. 24(2)). 

In addition, although the embodiment described above 
adaptively changes the interpolation function on the basis 
of the result of performing the frequency analysis (that is, 

is the FFT analysis) of signals in the signal interval also 
covering intervals before and after the interpolation object 
interval, analysis can be used instead of the FFT analysis, 
the analysis which is defined in the following equation and 
uses a short-time auto-correlation function. 



where W(n): Window function; and 
S(n): Sampling signal. 

In this case, with paying attention to a value of a 
normalized auto-correlation function 0(2T) /4>(0) at the time 
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of x = 2T, the interpolation apparatus changes the 
interpolation function. 

Furthermore, although the embodiment described 
above sets an interpolation object interval, whose length is 
the same as that of the second same value continuation 
interval, in the first same value continuation interval out of 
the first same value continuation interval and the second 
same value continuation interval, it can be performed in 
the contrary to set an interpolation object interval, whose 
length is the same as that of the first same value 
continuation interval, in the second same value 
continuation interval. 

Thus, the embodiment described above makes an 
interval as the interpolation object interval, the interval 
5 which is determined by making the start of the leading 
same value continuation interval as the starting point and 
making the start of the following same value continuation 
interval as the end point when there exist two same value 
continuation intervals adjacent to each other. Against this, 
o it is possible to make an interval as the interpolation object 
interval, the interval which is determined by making the 
end of the leading same value continuation interval as the 
starting point and making the end of the following same 
value continuation interval as the end point, and also in 
5 this case, the object desired can be achieved. Such a state 



23 



WO 01/28092 



PCT/JP00/02237 



that a signal level changes before and after the 
interpolation operation in this case is shown in FIG. 16. 
Embodiment of interpolation processing bv DSP 

In an interpolation method of the present invention, it 
is possible to perform real time processing by executing a 
program by using a digital signal processor (DSP) that is a 
microcomputer dedicated to signal processing. 

FIG. 1 is a block diagram showing the structure of an 
interpolation apparatus embodying an interpolation method 
according to the present invention. 

Reference character 1 denotes an input terminal for 
digital data after decompression of compressed voice data, 
and here, it is assumed that a series of digital data do, di, 
d 2 ,... is inputted, the series of digital data which is 
5 sampled with a sampling frequency f s , has quantization bit 
length n, and is expressed in the notation of two's 
complement. Reference character 2A denotes first memory, 
which has capacity capable of storing (N + 1) digital data in 
quantization bit length n' = (n + m) bits in address 0 to 
o address N. Reference character 2B denotes second 
memory having M memory regions composed of the first 
memory region to the Mth memory region, each memory 
region which stores by using a DSP (digital signal 
processor) described later amplitude every frequency (as 
s shown in FIG. 2, an amplitude value in a range of 0 to 
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-120(dB) (in addition, let the amplitude value 0 dB be Qm) , 
and relative spectrum length if it is defined that the 
spectrum length of the amplitude value 0 db is R M = 100 on 
a scale whose origin is -120(dB) and which is divided by 10 
5 dB to 0 dB) obtained from frequency component analysis by 
using FFT (measurement of frequency spectra) for the 
series of 512 digital data di, d i+ i, d i+2 , d i+5 n that are 
continuous in the first memory, with associating with an 
address range Ci to C 2 where the result of the FFT analysis 
10 can be used in the first memory. An address range where 
data used for a first FFT processing is stored is 0 to 511, 
and hence Ci = 0 and C 2 = 383. An address range where 
data used for a second FFT processing is stored is 256 to 
767, and hence Ci = 384 and C 2 = 639. An address range 
is where data used for a third FFT processing is stored is 512 
to 1023, and hence Ci = 640 and C 2 = 895 (see FIG. 8). 
Hereinafter, similarly, an address range where data used 
for a jth (j > 4) FFT processing is stored is (j - 1) x 256 to (j 
- 1) x 256 + 511, and hence Ci = (j - 2) x 256 + 384 and C 2 
20 = (j - 2) x 256 + 639. In addition, here, for convenience, it 
is assumed that N and M are sufficiently large. 

Reference character 3 denotes a DSP, which receives a 
series of digital data do, di, d 2 , ... from an input terminal 1 
and writes the series in the first memory 2A with extending 
25 them by m bits toward the low-order side in an input order 
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(concretely, in case of the notation of two's complement, m 
digits of O's are added to the low-order side of di if the MSB 
that is a sign binary digit of di is 0, and m digits of l's are 
added to the low-order side of di if the MSB that is the sign 
binary digit of di is 1). Although a waveform of a series of 
digital data whose quantization bit length is extended in n' 
= (n + m) bits changes stepwise and has quantization noise, 
the DSP 3 performs predetermined interpolation processing 
of data stored in the first memory 2A to reduce the 
quantization noise. The DSP 3 reads data after 
interpolation from the first memory 2A in order in parallel 
to these writing to the first memory 2A and interpolation 
processing, and outputs the data from an output terminal 4 
as a series of digital data Go, Gi, G 2 , which is sampled 
> by the sampling frequency f s and has quantization bit 
length n' = (n + m) bits. 
A. Curve interpolation 

FIGS. 3 and 4 are flow charts showing the main 
processing of the DSP 3, FIG. 5 is a flow chart showing FFT 
) processing executed by the multitask processing of the DSP 
3 in parallel to the main processing, FIG. 6 is a flow chart 
showing data input interruption handling by the DSP 3, 
and FIG. 7 is a flow chart showing data output interruption 
handling by the DSP 3. FIG. 8 is an explanatory diagram 
5 of FFT operation by the DSP, FIGS. 9 and 10 are 



26 



WO 01/28092 



PCT/JPOO/02237 



explanatory diagrams showing an example of series of data 
stored in the first memory 2A, and hereinafter, 
interpolating operation will be described with reference to 
these drawings. Here, assuming that n = 8 and m = 4, 
description will be performed. In addition, it is assumed 
that data stored in an address i of the first memory 2A are 
expressed as Di, Di\ D(i), Di.d (d: an arbitrary integer), Di.d. 
In addition, it is assumed that the possible maximum value 
of amplitude values every frequency that are obtained with 
frequency analysis by using FFT is Qm = 0 dB and spectrum 
length of the amplitude value 0 dB is R M = 100 (see FIG. 2). 

First, the DSP 3 not only clears all the regions of the 
first memory 2A and second memory 2B by means of 
initialization, but also makes a write pointer RP and a read 
5 pointer WP to the first memory 2A be 0 (step S10 in FIG. 3). 
Subsequently, the DPS 3 executes the data input 
interruption handling, shown in FIG. 6, each time new 
digital data di (i = 0, 1, 2,...) with bit length n = 8 is 
inputted into the input terminal 1, and not only writes the 
o digital data in an address shown by RP in the first memory 
2A with extending the digital data by m = 4 bits toward the 
low-order side, but also performs increment processing of 
RP (steps S50 and S51; see FIG. 9). In addition, after the 
number of input data exceeds 1024, the DSP 3 performs 
s data output interruption handling, shown in FIG. 7, in a 
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period To = (l/f s ), reads data D(WP) from an address shown 
by WP in the first memory 2A to output the data as Gwp, 
and increments WP (steps S60 and S61). 

After the initialization, the DSP 3 refers to the first 
5 memory 2A from the starting address side and searches 
whether an interval where a plurality of same value data 
continue exists in the input series of data (steps Sll and 
S12 in FIG. 3). When finding a first same value 
continuation interval (YES at step S12), the DSP 3 
10 subsequently checks whether the end of the same value 
continuation interval is determined (step S13). The DSP 3 
judges that the end is not determined if the newest input 
data corresponds to the end of the same value continuation 
interval found this time (see D« in FIG. 9(1)), and in this 
is case, the DSP 3 waits for the end being determined with a 
subsequent data input. Differently from this, if data 
having a value different from that in the same value 
continuation interval is stored just after the same value 
continuation interval found this time (see D 5 in FIG. 9(2)), 
20 the DSP 3 judges that the end of the same value 
continuation interval is determined. 

If judgment is YES at step S13, the DSP 3 makes the 
same value continuation interval, found this time, as a first 
same value continuation interval, and stores its starting 
25 address, end address, data value, and a number of data as 
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Si, Ei, Yi, and Li respectively (step S14). In FIG. 9(2), Si 
= 1, E i =5, and Li = 5. Next, the DSP 3 refers to the first 
memory 2A and checks whether a same value continuation 
interval having values different from those in the first same 
5 value continuation interval exists just after the first same 
value continuation interval (step S15). If it does not exist, 
the DSP 3 refers to the first memory 2A and searches a 
next same value continuation interval in the input series of 
data (steps S16 and S17), and if the same value 
10 continuation interval is found, the process goes to the step 
S13 for the DSP 3 to perform the same processing as 
described above. 

Here, assuming that, as shown in FIG. 9(2), a same 
value continuation interval having values different from 
15 those in the first same value continuation interval, exists 
just after the first same value continuation interval, the 
DSP 3 subsequently checks whether the end of the same 
value continuation interval is determined (step S18). The 
DSP 3 judges that the end is not determined if the newest 
20 input data corresponds to the end of the same value 
continuation interval, and the DSP 3 waits for the end 
being determined with a subsequent data input, but, if data 
having values different from those in the same value 
continuation interval is stored just after the same value 
25 continuation interval (see D l0 in FIG. 9(2)), the DSP 3 
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judges that the end of the same value continuation interval 
is determined as the second same value continuation 
interval, and the DSP 3 stores its starting address, end 
address, data value, and a number of data as S2, E 2 , Y 2 , 
5 and L 2 respectively (step S 19). In FIG. 9(2), S 2 = 6, E 2 = 9, 
and L 2 = 4. 

Next, as described later in detail, the DSP 3 
determines all of the first same value continuation interval 
or part of the first same value continuation interval just 
10 before the second same value continuation interval as an 
interpolation object interval, and hence the DSP 3 refers to 
the second memory 2B, checks whether FFT, including the 
end address Ei of the first same value continuation interval 
in the object address range Ci to C 2 where the result of the 
15 FFT can be used, is completed, and if not, the DSP 3 waits 
for completion (step S20). 

The DSP 3 performs the FFT processing, shown in FIG. 
5, in parallel to main processing, shown in FIGS. 3 and 4, 
by using multitask processing. In FIG. 5, first, with 
20 letting k, determining a range of data used for the FFT 
processing in the first memory 2A, be 0, and letting P, 
determining a memory region where the result of the FFT 
processing is stored in the second memory 2B, be 1 (step 
S31), the DSP 3 waits for the first to 512th data do, di, 
25 dsn being inputted from the input terminal 1 and stored 
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into the first memory 2A (step S32). If judgment is YES at 
the step S32, the DSP 3 performs the FFT processing by 
using these first to 512th data, obtains the amplitude of 
components (amplitude values and relative length of a 
s spectrum; see FIG. 2) every frequency, and not only stores 
the amplitude in a first memory region of the second 
memory 2B, but also stores the address range Ci to C 2 , 
where the result of the FFT processing performed this time 
can be used, out of the first memory 2A in the first region 
io (step S33). As shown in FIG. 8(1), in case of the first FFT, 
it is made that Ci = 0 and C 2 = 383. In addition, it is 
assumed that one cycle of FFT processing is completed 
within the time (= 256 x (l/f s )) necessary for inputting 256 
data di. 

is After the step S33, the DSP 3 increments P to 2 (step 

S34) and waits for the 255th to 767th data being inputted 
from the input terminal 1 and stored into the first memory 
2A (step S35). If judgment is YES at the step S35, the DSP 
3 performs the FFT processing by using these 255th to 

20 767th data, obtains amplitude values every frequency and 
relative length of a spectrum, and not only stores them into 
a second memory region of the second memory 2B, but also 
stores the address range Ci to C 2 , where the result of the 
FFT processing obtained this time can be used, out of the 

25 first memory 2A in the second memory region (step S36). 
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As shown in FIG. 8(2), in case of the second FFT, it is made 
that Ci = 384 and C 2 = 639. 

After the step S36, the DSP 3 increments k to 1, and 
increments P to 3 (step S37). Then, the DSP 3 waits for 
s the 513th to 1024th data being inputted from the input 
terminal 1 and stored into the first memory 2A (step S32). 
If judgment is YES at the step S32, the DSP 3 performs the 
FFT processing by using these 513th to 1024th data, 
obtains amplitude values every frequency and relative 
10 length of a spectrum, and not only stores them into a third 
memory region of the second memory 2B, but also stores 
the address range Ci to C 2 , where the result of the FFT 
processing obtained this time can be used, out of the first 
memory 2A in the third memory region (step S33). As 
is shown in FIG. 8(3), in case of the third FFT, it is made that 
Ci = 640 and C 2 = 895. 

Hereinafter, the DSP 3 repeats similar processing, 
analyzes frequency components by means of the FFT 
processing by using data in a certain period out of the 
20 input series of data, and obtains amplitude values every 
frequency and relative length of a spectrum. 

If judgment is YES at the step S20 during main 
processing shown in FIGS. 3 and 4 in process of the FFT 
processing described above, the DSP 3 compares Li with L 2 
25 (step S21 in FIG. 4), and if Li > L 2 , the DSP 3 determines a 
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range, where L 2 data just before the second same value 
continuation interval out of the first same value 
continuation interval exists, as the interpolation object 
interval (step S22). If Li < L 2 , the DSP 3 determines the 
5 entire first same value continuation interval as the 
interpolation object interval (step S27). 

In the case of FIG. 9(2), since judgment becomes YES 
at step S21, the DSP 3 refers to the amplitude values every 
frequency and relative spectrum length, stored in the 
10 memory region (here, the first memory region) including the 
address Ei out of the second memory 2B in the address 
range Ci to C 2 , where the result of frequency component 
analysis with the FFT can be used after executing the 
processing at the step S22, and lets the time length of the 
is interpolation object interval be T, lets the amplitude value 
in the frequency 1/2T = f s /2L 2 be q a , lets the relative 
length of a spectrum be r a , lets the amplitude value in the 
frequency fmax, the value of which is the largest, be q ma x, 
and lets the relative length of its spectrum be r ma x (step 
20 S23; see FIG. 2). Then, the DSP 3 checks whether r a /r ma x 
is equal to or more than a predetermined reference value Co 
(step S24). Since the influence of an error caused by noise 
becomes large if r a /r ma x is less than Co, accurate 
interpolation cannot be performed, and hence the 
25 interpolation processing in the interpolation object interval 
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found this time is not performed. If judgment is YES at 
the step S24, the DSP 3 performs interpolation processing 
in the interpolation object interval, found this time, by 
replacing values of digital data in the interpolation object 
s interval in the first memory 2A according to an 
interpolation function whose values monotonously change 
from the start of the interpolation object interval to the 
start of the second same value continuation interval (step 
S25). 

io If judgment is YES at the step S2 1 and YES at the step 

S24, the DSP 3 performs interpolation in the interpolation 
object interval found this time by replacing the data D(Si + 
j) in the address (Si + j) in the first memory 2A with Y(Si + 
j) (step S25). In FIG. 10(1), D(3), D(4), and D(5) are 

is replaced. 

After the step S25, the DSP 3 replaces Si with S 2 , Ei 
with E 2 , Yi with Y2, and Li with L 2 , makes the second same 
value continuation interval, found this time, as a new first 
same value continuation interval (step S26), and returns to 

20 step S15 in FIG. 3. At the step S15, the DSP 3 refers to 
the first memory 2A, checks whether a same value 
continuation interval having values different from those in 
the first same value continuation interval, exists just after 
the first same value continuation interval, and if does not 

25 exist, the DSP 3 refers to the first memory 2 A, and 
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searches a next same value continuation interval in the 
input series of digital data (steps S16 and S17), and if the 
same value continuation interval is found, the process goes 
to step S13 for the DSP 3 to perform the same processing 
as described above. 

Here, if another same value continuation interval 
having values different from those in the first same value 
continuation interval, exists just after the first same value 
continuation interval from the address Si = 6 to Ei = 9 as 
shown in FIG. 10(2), the DSP 3 subsequently checks 
whether the end of the other same value continuation 
interval is determined (step S18). The DSP 3 judges that 
the end is not determined if the newest input data 
corresponds to the end of the same value continuation 
interval, and the DSP 3 waits for the end being determined 
with a subsequent data input, but, if data having values 
different from those in the other same value continuation 
interval that is equal is stored just after the other same 
value continuation interval, the DSP 3 judges that the end 
of the other same value continuation interval is determined 
(see FIG. 10(2)), and the DSP 3 makes the other same value 
continuation interval as the second same value 
continuation interval and stores its starting address, end 
address, data value, and a number of data as S 2 , E 2 , Y 2 , 
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and L 2 respectively (step S19). In FIG. 10(2), S 2 = 10, E 2 = 
14, and L 2 = 5. 

Next, the DSP 3 checks whether the FFT is completed, 
the FFT including the end address Ei = 9 of the first same 
value continuation interval in the address range Ci to C 2) 
where the result of frequency component analysis with FFT 
processing can be used, and if judgment is YES here, the 
process goes to step S21 in FIG. 4. At the step S21, the 
DSP 3 compares Li and L 2 , and since Li < L 2 this time, the 
DSP 3 determines the entire first same value continuation 
interval as the interpolation object interval (step S27). 
Since same value continuation intervals, which are similar 
to the first same value continuation interval, periodically 
appear frequently in the input series of digital data, the 
5 DSP 3 makes a sinusoidal wave component of an 
interpolation waveform in the interpolation object interval 
be suitable to a frequency component, which a signal 
waveform of the series of digital data before the 
interpolation has in a predetermined interval covering 
o intervals before and after the first same value continuation 
interval by making the time length of the interpolation 
object interval be the same as that in the first same value 
continuation interval if Li < L 2 . Owing to this, it is 
possible to reduce the quantization noise without a feeling 
5 of strangeness by preventing a frequency component from 



36 



WO 01/28092 



PCT/JP00/02237 



being excessively emphasized from the viewpoint of 
frequency components that the series of digital data before 
the interpolation has before and after the first same value 
continuation interval. Furthermore, since a low pass filter 
5 is not used, the group delay frequency characteristic never 
becomes worse. 

The DSP 3 refers to amplitude values every frequency 
stored in the first memory region including the address Ei 
in the address range Ci to C 2 , where the result of frequency 

10 component analysis can be used with the FFT processing, 
out of the second memory 2B, lets an amplitude value in 
the frequency component with f s /2Li be q a , lets relative 
length of a spectrum be r a , lets an amplitude value in the 
frequency f max , the value of which is the largest, be q ma x, 

is and lets the relative - length of its spectrum be r max (step 
S28). 

Then, the DSP 3 checks whether r a /r max is equal to or 
more than a predetermined reference value Co (step S29). 
Since the influence of an error caused by noise becomes 

20 large if r a /r ma x is less than Co, the interpolation processing 
in the interpolation object interval found this time is not 
performed. If judgment is YES at the step S29, the DSP 3 
performs interpolation processing in the interpolation 
object interval, found this time, by replacing values of 

25 digital data within the interpolation object interval in the 
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first memory 2A according to an interpolation function 
whose values are adaptively changed according to the 
result of the frequency component analysis with the FFT 
near the interpolation object interval to the series of digital 
5 data before the interpolation so that the values may 
monotonously change from the start of the interpolation 
object interval to the start of the second same value 
continuation interval (step S30). 

Concretely, if judgment is NO at the step S21 and YES 
10 at the step S29, the DSP 3 performs interpolation in the 
interpolation object interval, found this time, by letting the 
interpolation function Y(Si + j) (j: discrete variable) be: 

Y(Si + j) = Yi + (Y 2 - Yi)#G(2j/Li) 

where j = 1, 2, (Li - 1), and replacing the data D(Si 
15 + j) in the address (Si + j) in the first memory 2A with Y(Si 
+ j) (step S30). In FIG. 10(2), D(7), D(8), and D(9) are 
replaced. 

For example, if r a = Rm, F 2 (x) = 1, and hence G(x) = 

Fi(x). 

20 After the step S30, the DSP 3 replaces Si with S2, Ei 

with E2, Yi with Y2, and Li with L2, makes the second same 
value continuation interval, found this time, as a new first 
same value continuation interval (step S26), returns to the 
step S15 in FIG. 3, and subsequently repeats the similar 

25 processing. 
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The series of digital data Do, Di, D 2 , ... with 
quantization bit length = n* bits after the interpolation that 
is stored in the first memory 2A is sequentially read at a 
period of l/f s with the data output interruption handling 
shown in FIG. 7, and is outputted as the series of digital 
data Go, D 1, D2, — 

In addition, although the embodiment described above 
sets an interpolation object interval, having the length 
same as that of the second same value continuation 
interval, in the first same value continuation interval 
between the first same value continuation interval and the 
second same value continuation interval, as a modified 
example, it can be performed to set an interpolation object 
interval, having the length same as that of the first same 
value continuation interval, in the second same value 
continuation interval. Concretely, the DSP 3 can perform 
the main processing shown in FIGS. 14 and 15 respectively 
instead of those in FIGS. 3 and 4 among the flow charts in 
FIGS. 3 to 7. 
B. Linear interpolation 

In addition, although it is made in the embodiment 
and modified embodiment to perform the curve 
interpolation of an interpolation object interval in the first 
same value continuation interval or the second same value 
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continuation interval, it can be made to perform linear 
interpolation. 

Concretely, when performing the linear interpolation 
by setting an interpolation object interval in the first same 
value continuation interval, the DSP 3 can perform the 
main processing shown in FIGS. 17 and 18 respectively 
instead of those in FIGS. 3 and 4 among the flow charts in 
FIGS. 3 to 7. 

Processing in FIGS. 17 and 18 will be simply described. 
Nevertheless, it is assumed that the input series of digital 
data do, di,... is the same as that in FIGS. 9 and 10. Quite 
similarly to steps S10 to S19 in FIG. 3, data Di to D 5 in 
addresses 1 to 5 in the first memory 12A is made to be a 
first same value continuation interval, and addresses 6 to 9 
are made to be a second same value continuation interval 
(steps S10 to S19 in FIG. 17; see FIG. 19(1)). 

Next, the DSP 3 compares Li with L 2 (step S2 1 in FIG. 
18), and if Li £ L 2 , the DSP 3 determines a range, where L 2 
data just before the second same value continuation 
interval out of the first same value continuation interval 
exists, as the interpolation object interval (step S22). If Li 
< L 2 , the DSP 3 determines the entire first same value 
continuation interval as the interpolation object interval 
(step S27). 
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In FIG. 19(1), since judgment becomes YES at step 
S2 1, the DSP 3 performs interpolation processing by 
replacing values of digital data in the interpolation object 
interval in the first memory 2A according to an 
5 interpolation function whose values linearly change 
monotonously from the start of the interpolation object 
interval to the start of the second same value continuation 
interval (step S60) after executing the processing at the 
step S22. 

10 Concretely, the DSP 3 performs the interpolation 

processing by letting an interpolation function Y(Si + j) 
which indicates the relationship between an address of 
respective data in the interpolation object interval (Si + j) 
and the value Y of respective data after interpolation (j: 

15 discrete variable; Si + j expresses an address in the first 
memory 2A) be: 

Y(S, + j) = Yi + {(Y 2 - Yi)/L 2 }.j 

where j = 1, 2, .... (L 2 - 1), and replacing the data D 3 , 
D 4 , and D 5 in the addresses 3, 4, and 5 in the first memory 
20 2 A according to the following formula: 

D(Si + j) <- Y(Si + j) (see an interpolation straight line 
E and D 3 ', D 4 ' and D 5 ' in FIG. 19(1)). 

After the step S60, the DSP 3 replaces Si with S 2 , Ei 
with E 2 , Yi with Y 2 , and Li with L 2 , makes the second same 
2 5 value continuation interval, found this time, as a new first 
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same value continuation interval (step S26), returns to the 
step S15 in FIG. 17. At the step S15, the DSP 3 refers to 
the first memory 2A and checks whether a same value 
continuation interval having values different from those in 
the first same value continuation interval exists just after 
the first same value continuation interval. If it does not 
exist, the DSP 3 refers to the first memory 2A and searches 
a next same value continuation interval in the input series 
of data (steps S16 and S17), and if the same value 
continuation interval is found, the process goes to the step 
S13 for the DSP 3 to perform the same processing as 
described above. 

Here, assuming that, as shown in FIG. 19(2), another 
same value continuation interval having values different 
s from those in the first same value continuation interval, 
exists just after the first same value continuation interval 
from the address Si = 6 to Ei = 9, the DSP 3 subsequently 
checks whether the end of the other same value 
continuation interval is determined (step S18). If 
o judgment is YES, the DSP 3 makes the other same value 
continuation interval as the second same value 
continuation interval, and stores its starting address, end 
address, data value, and a number of data as S2, E 2 , Y 2 , 
and L 2 respectively (step S19). In FIG. 19(2), S 2 = 10, E 2 = 
5 14, and L 2 = 5. 
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Next, the process goes to step S2 1 in FIG. 18. At the 
step S21, the DSP 3 compares Li and L 2 , and since Li < L 2 , 
the DSP 3 determines all the first same value continuation 
interval as the interpolation object interval (step S27). 
5 Since same value continuation intervals, which are similar 
to the first same value continuation interval, periodically 
appear frequently in the series of digital data before and 
after the first same value continuation interval, having 
large quantization noise, such as a music signal, the DSP 3 
10 can make a sinusoidal wave component of an interpolation 
waveform in the interpolation object interval be suitable to 
a frequency component, which a signal waveform of the 
original series of digital data before the interpolation has in 
a predetermined interval covering intervals before and after 
is the first same value continuation interval by making the 
time length of the interpolation object interval be the same 
as that in the first same value continuation interval, and 
hen«ce, it is possible to effectively reduce the quantization 
noise by preventing a frequency component from being 
20 excessively emphasized from the viewpoint of frequency 
components that the original series of digital data has 
before and after the first same value continuation interval. 
Furthermore, since a low pass filter is not used, the group 
delay frequency characteristic never becomes worse. 
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Subsequently to the step S27, the DSP 3 performs the 
interpolation processing by replacing values of the digital 
data in the interpolation object interval in the first memory 
2A according to an interpolation function whose values 
s linearly change monotonously from the start of the 
interpolation object interval to the start of the second same 
value continuation interval (step S61). 

Concretely, the DSP 3 performs the interpolation 
processing with letting an interpolation function Y(Si + j) 
10 which indicates the relationship between an address of 
respective data in the interpolation object interval (Si + j) 
and the value Y of respective data after interpolation (j: 
discrete variable; Si + j expresses an address in the first 
memory 2A) be: 
is Y(S, + j) = Y, + {(Y 2 - Yi)/Li}.j 

where j = 1, 2, (Li - 1), and replacing the data D 7 , 
D 8 , and D 9 in the addresses 7, 8, and 9 in the first memory 
2A according to the following formula: 

D(Si + 1) <- Y(Si + j) (see an interpolation straight line 
20 F and D 7 \ D 8 ' and D 9 ' in FIG. 19(2)). 

After the step S61, the DSP 3 replaces Si with S 2 , Ei 
with E 2 , Yi with Y 2 , and Li with L 2 , makes the second same 
value continuation interval, found this time, as a new first 
same value continuation interval (step S26), returns to the 



44 



WO 01/28092 



i 



PCT/JP00/02237 



step S15 in FIG. 17, and subsequently repeats the similar 
processing. 

The series of digital data Do, Di, D 2> ... with 
quantization bit length = n' bits after the interpolation that 
5 is stored in the first memory 2A is sequentially read at a 
period of l/f s with the data output interruption handling 
shown in FIG. 7, and is outputted as the series of digital 

data Go, Di, D2, — 

In addition, although the embodiments in FIGS. 17 
10 and 18 perform linear interpolation by setting an 
interpolation object interval in the first same value 
continuation interval, it can be made to perform linear 
interpolation by setting an interpolation object interval in 
the second same value continuation interval similarly to 
15 the case of the curve interpolation. 

Concretely, the DSP 3 can perform the main 
processing shown in FIGS. 17 and 20 respectively instead 
of those in FIGS. 3 and 4 among the flow charts in FIGS. 3 
to 7. 

20 In addition, although, in the embodiments and 

modified embodiments according to the curve interpolation 
and linear interpolation that are described above, 
description is performed with exemplifying n = 8 and m = 4, 
the present invention is never limited to these, but the 

25 present invention can be similarly applied even if n and m 



45 



WO 01/28092 



PCT/JPOO/02237 



are other values such as n = 16 and m = 4, and n = 20 and 
m = 6. In addition, the present invention can be similarly 
applied also in case a series of data do', di\ d2',.-- after 
expanding do, di, d 2> ... by m bits toward the low-order side 
s is inputted into the input terminal and the DSP writes 
these data into the first memory as it is. 
Processing of digital image signal 

Although the above-described description of an 
interpolation processing method of the present invention is 
10 performed with supposing a digital audio signal obtained by 
sampling and quantizing music sound or voice as a digital 
signal, the interpolation method of the present invention 
can also be applied to a digital image signal. Hereinafter, 
the interpolation processing of the digital image signal 
is according to the present invention will be described. 

Although the interpolation processing method of the 
present invention can also be applied to the digital image 
signal as it is, against the audio signal simply expressing 
time fluctuation of an instantaneous value of sound 
20 pressure, the image signal has such specificity that the 
image signal is accompanied by a two-dimensional visual 
spatiality. 

For example, a TV signal is a time series of luminance 
levels (in the case of color, time series of respective R, G, 
25 and B gradations) in essence, and this signal is scanned 
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from the left to the right on the horizontal line of a screen, 
and is vertically scanned sequentially from the uppermost 
line to the next line downward. When one frame is 
completed, the scanning is moved to the next frame, similar 
horizontal/vertical scanning is repeated, and in 
consequence, an image is displayed. Therefore, when the 
digital image signal is processed, it is necessary to pay 
attention to the fluctuation of gradation levels in the 
horizontal and vertical direction in a frame and that in the 
interframe direction. FIG. 25 is a diagram showing a 
frame concept as property accompanied with such an image 
signal, reference character 10 denotes a current frame, 
reference character 11 denotes a frame immediately after 
the current frame, and reference character IN denotes a 
s frame after N frame time passing. In addition, plenty of 
small partitions in the current frame represent pixels, and 
for example, reference character 20 denotes the third pixel 
from the left on the tenth line. Here, for convenience, it is 
assumed that the horizontal direction (line direction) in a 
o frame is called the x direction, the vertical direction in the 
frame is the y direction, and the interframe direction is the 
z direction. 

An object of image signal interpolation processing of 
the present invention is a compressed digital image signal 
s such as an inter-frame differential signal, or an in-frame 
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digitization cosine function transformation (DCT) signal. 
In the case of the former, difference of gradation levels of 
respective pixels between frames is the object of the 
interpolation processing, and in the case of the latter, each 
DCT coefficient obtained by blocking a frame and 
performing DCT transformation in each block is the object 
of the interpolation processing. Hereinafter, these are 
simply called gradation levels and DCT coefficients. 

FIG. 26 is a diagram showing fundamental blocks for 
i the interpolation processing of an image signal. It is 
assumed that, since the pixel signal includes gradation 
levels of three colors such as R, G, and B, first, this is 
separated, the interpolation processing is performed every 
color, these R, G, and B are synthesized after the 
j interpolation processing, and an interpolated signal output 
is obtained (FIG. 26(1)). 

In addition, if a pixel image signal is not composed of 
R, G, and B, but is composed of luminance (Y) and color 
difference (I, Q), the pixel signal is separated into Y, I, and 
o Q, and the interpolation processing is performed for 
respective gradation levels of Y, I, and Q. The 
interpolation processing of respective R, G, and B is 
performed in the block structure shown in FIG. 26(2). 
First, a given digital image signal (a series of gradation 
5 levels or DCT coefficients) is inputted into an x direction 
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interpolation unit 30, and the interpolation processing in 
the x direction (the horizontal direction in a frame) is 
performed. Next, the series of levels in the x direction is 
transformed into a series of levels in the y direction by an 
5 x/y transformation unit 31, and the interpolation 
processing in the y direction (the vertical direction in the 
frame) is performed. After that, a series of levels in the z 
direction (the interframe direction) is obtained by a y/z 
transformation unit 33, the interpolation processing in the 
10 z direction (the interframe direction) is performed, and 
finally, z/x transformation is performed, and the digital 
image signal, the interpolation processing of which is 
completed in all of the x, y, and z directions, is obtained as 
an output to be provided to an application device such as a 

is display device. 

The above-described transformation processing in the 
series-of-levels transformation units 31, 33, and 35 is 
performed by providing frame memory, and performing 
reading from and writing into this (with switching a write 

20 address and a read address). FIG. 27 is a conceptual 
drawing of series-of-levels transformation by means of this 
write/read operation. 

FIG. 28 is a diagram showing a concrete circuit 
diagram as an embodiment of the series-of-levels 

2 5 transformation unit. In this diagram, reference characters 
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41 and 44 denote image memory with predetermined 
capacity, reference characters 40 and 43 denote three-state 
buffers, reference characters 42, 45, and 46 denote 
selectors that select one of inputs X 0 and Xi and make it as 

5 a Y output, and reference character 49 denotes an address 
generator composed of a write address and a read address. 
In addition, reference character 47 denotes a signal 
generator generating a clock at a sampling frequency, and 
reference character 48 denotes a frequency divider. 

io The transformation operation will be described with 

taking the x/y transformation processing as an example. 
The frequency divider 48 is made to divide the sampling 
frequency Sr by two times the frame of pixels (m x n). 
Thus the frequency F f of the output F of the frequency 

is divider is: 

Fr = Sr/2 x m x n. 

At this time, the output F of the frequency divider is a 
signal where "L" and "H" are alternately switched every m x 
n times the sampling cycle (FIG. 29(d)). The image memory 
20 41 and 44 are made to include capacity corresponding to a 
frame, that is, m x n locations whose addresses are 
expressed in the following matrix with m rows and n 
columns. 
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"(1,1) (1,2) (1,3) K (1, n) 

(2,1) (2,2) (2,3) K (2, n) 
(3,1) O M 

M O M 

(m,l) A A A (m, n) 

When the output F of the frequency divider is "H," "L" 
is applied to an R/W terminal of the image memory 41 and 
"H" is applied to an R/W terminal of the image memory 44, 
5 and hence, in this period, not only the image memory 41 
becomes write memory, but also the image memory 44 
becomes read memory. Although the image memory 4 1 
and 44 are provided with a bilateral I/O terminal D 
respectively, at this time, an input signal is applied only to 

10 the D terminal of the memory 41 through the three-state 
buffer 40 and the output of the three-state buffer 43 
becomes high impedance, and hence the output from the 
memory 44 is not applied to the memory 44 and also does 
not hinder the output of the memory 44. At this time, 

is since S inputs to the selectors 45 and 46 are "H" and "L" 
respectively, Xi, that is, a W address is outputted from a Y 
output of the selector 45 and Xo, that is, an R address is 
outputted from a Y output of the selector 46, and 
respective addresses are applied to respective A terminals 

20 (address terminals) of the memory 41 and 44. More 
concretely, since W addresses (1, 1), (1, 2), (1, 3), (1, 4), 
(1, n), (2, 1), (2, 2), (2, n), and (m, n) are applied to 
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the memory 41 in this order, the image signal is written in 
an ordinary scanning form (a left side in FIG. 27(a)). On 
the other hand, since R addresses (1, 1), (2, 1), (3, 1), (4, 

1) (m, 1), (1, 2), (2, 2), (1, n), (2, n), and (m, n) 

s are applied to the memory 44 in this order, the image 
signal is read in the vertical direction (a right side in FIG. 
27(a)). Since the output F of the frequency divider 48 
changes to "L" when a frame of writing and reading is 
completed, reading/writing functions of the memory 41 and 
10 44 are quite reversed at this point, both memories operate 
so that data may be written into the memory 44 while data 
stored before may be read from the memory 41. In this 
manner, on the basis of the output F of the frequency 
divider, the horizontal writing and vertical reading of the 
is image signal is controlled, and it is achieved to perform the 
x/y series-of-levels transformation that is the desired 
object. Although it is possible to perform the y/z 
transformation and z/x transformation with similar 
processing, in this case, it is necessary to provide memory 
20 capacity corresponding to intervals in the interframe 
direction to be interpolated. For example, in case 
processing in the interframe direction covering K frames is 
an object, it is necessary to provide image memory having 
capacity corresponding to K frames. 
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In addition, although, in the above-described 
embodiments of image signal processing, separate 
interpolation processing is performed in the horizontal 
direction and vertical direction in a frame, in-frame 
interpolation processing can be performed in a lump. For 
example, as shown in FIG. 30(c), it is conceivable to use 
transversal filter consisting of a plurality of sampling-cycle 
delay lines S and line-period delay lines L, multipliers 51 to 
59 multiplying the input a !+ i and outputs of respective 
delay lines, ai to a-i-i, by predetermined coefficients Wi+i to 
W-i-i, and an adder 60 summing the result of multiplication. 
In this example, with letting a block with 3x3 pixels (FIG. 
30(a)) be a processing unit, and letting a gradation level of 
a pixel concerned be a 0 , it is performed to multiply 
gradation levels of pixels near it, a-i-i, a-i, a-i+i, .... ai, ai+i, 
by predetermined weights, that is, W-i-i, W-i, W-i + i, Wi, 
Wi+i, its sum is made an output corresponding to ao, next, 
the same calculation is performed for a pixel level a+i, and 
this is performed for all the pixels in the frame. In 
o addition, although, in the above-described description with 
reference to FIG. 30, the block with 3x3 pixels is took as 
an example for simplification, of course, it is also possible 
to perform calculation by using a necessary number of 
block size in consideration of an object of interpolation 
5 processing. 



53 



WO 01/28092 



PCT/JPOO/02237 



CLAIMS 

1. A method for processing a digital signal that has a 
predetermined sampling cycle and quantization bit length, 
5 characterized by performing interpolation processing of 
signal levels within an interpolation object interval in 
accordance with a predetermined function curve which 
monotonously changes, with the interpolation object 
interval, including a discontinuous part, which exists 
10 between one signal interval, where the same levels continue, 
and another signal interval, which is adjacent to the one 
signal interval and in which the same level different from 
them continue. 

is 2. The method according to claim 1, wherein a change 
characteristic of the function curve is adaptively changed 
accordance with a degree of periodicity of a signal in an 
interval covering intervals before and after the 
interpolation object interval. 

20 

3. The method according to claim 2, wherein the degree 
of periodicity of a signal is detected by using frequency 
analysis. 
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4. The method according to claim 2, wherein the degree 
of periodicity of a signal is detected by using 
auto-correlation function analysis. 

5 5. The method according to claim 3, wherein be T, the 
function curve is adaptively changed in accordance with a 
level of a frequency component at a frequency f = 1/2T 
where T is a time length of the interpolation object interval. 

io 6. The method according to any one of claims 1 to 5, 
wherein it is defined that the interpolation object interval 
is an interval whose starting point is a start of a preceding 
same level continuation interval and whose end point is a 
start of a succeeding same level continuation interval. 

15 

7. The method according to any one of claims 1 to 5, 
wherein it is defined that the interpolation object interval 
is an interval whose starting point is an end of a preceding 
same level continuation interval and whose end point is an 

20 end of a succeeding same level continuation interval. 

8. The method according to any one of claims 1 to 5, 
wherein it is defined that the interpolation object interval 
is an interval whose starting point is a nearly median point 

25 of a preceding same level continuation interval and whose 
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end point is a nearly median point of a succeeding same 
level continuation interval. 

9. The method according to any one of claims 1 to 5, 
5 wherein the digital signal is a digital audio signal. 

10. The method according to any one of claims 1 to 5, 
wherein the digital signal is a digital image signal. 

10 11. The method according to claim 9, wherein the level 
corresponds to an amplitude value of an audio signal. 

12. The method according to claim 10, wherein the level 
corresponds to a gradation value of an image signal. 

15 

13. An apparatus processing a digital signal that has a 
predetermined sampling cycle and quantization bit length, 
characterized by: 

detection means for detecting one signal interval, 
20 where the same levels continue, and another signal interval, 
which is adjacent to the one signal interval and in which 
the same levels different from them continue; 

determination means for determining a predetermined 
signal interval, including a discontinuous part between 
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signal intervals adjacent to each other, as an interpolation 
object interval; and 

interpolation means for performing interpolation 
processing of signal levels in the interpolation object 
5 interval in accordance with a predetermined function curve 
that monotonously changes. 

14. The apparatus according to claim 13, wherein the 
interpolation means operates so as to make a change 
10 characteristic of the function curve adaptively change in 
accordance with a degree of periodicity of a signal in an 
interval covering intervals before and after the 
interpolation object interval. 

is 15. The apparatus according to claim 14, wherein the 
interpolation means includes means for detecting the 
degree of periodicity of a signal by using frequency 
analysis. 

20 16. The apparatus according to claim 14, wherein the 
interpolation means includes means for detecting the 
degree of periodicity of a signal by using auto-correlation 
function analysis. 
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17. The apparatus according to claim 15, wherein the 
interpolation means makes the function curve change in 
accordance with a level of a frequency component at a 
frequency f = 1/2T where T is a time length of the 
interpolation object interval. 

18. The apparatus according to any one of claims 13 to 17, 
wherein the determination means operates so as to define 
that the interpolation object interval is an interval whose 
starting point is a start of a preceding same level 
continuation interval and whose end point is a start of a 
succeeding same level continuation interval. 

19. The apparatus according to any one of claims 13 to 17, 
5 wherein the determination means operates so as to define 

that the interpolation object interval is an interval whose 
starting point is an end of a preceding same level 
continuation interval and whose end point is an end of a 
succeeding same level continuation interval. 

o 

20. The apparatus according to any one of claims 13 to 17, 
wherein the determination means operates so as to define 
that the interpolation object interval is an interval whose 
starting point is a nearly median point of a preceding same 

5 level continuation interval and whose end point is a nearly 
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median point of a succeeding same level continuation 
interval. 

21. The apparatus according to any one of claims 13 to 17, 
wherein the digital signal is a digital audio signal. 

22. The apparatus according to any one of claims 13 to 17, 
wherein the digital signal is a digital image signal. 

23. The apparatus according to claim 2 1, wherein the level 
corresponds to an amplitude value of an audio signal. 

24. The apparatus according to claim 22, wherein the level 
corresponds to a gradation value of an image signal. 

25. A method for processing a digital signal that has a 
predetermined sampling cycle and quantization bit length, 
said method comprising the steps of: 

sequentially detecting signal intervals, where a 
plurality of same quantization levels continue; 

determining a predetermined signal interval, including 
a discontinuous part between two signal intervals adjacent 
to each other, as an interpolation object interval; 
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detecting a degree of periodicity of a signal in an 
interval covering intervals before and after the 
interpolation object interval; and 

performing interpolation processing of signal levels in 
5 the interpolation object interval in accordance with a 
predetermined function curve with adaptively changing a 
change characteristic of the predetermined function curve 
that monotonously changes, on the basis of the degree of 
periodicity that is detected. 

10 

26. The method according to claim 25, wherein the 
characteristic of the function curve change so that the 
function curve may gently change when the degree of the 
periodicity of a signal is large, and the function curve may 

is sharply change if the degree is small. 

27. The method according to claim 25, wherein the step of 
performing interpolation processing includes a step of 
detecting the degree of periodicity of a signal by using 

20 frequency analysis. 

28. The method according to claim 25, wherein the step of 
performing interpolation processing includes a step of 
detecting the degree of periodicity of a signal by using 

25 auto-correlation function analysis. 
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29. The method according to claim 27, comprising letting 
each of intervals where the plurality of same levels 
continue be an interpolation object interval, and the 
frequency analysis measuring a level of a frequency 
component at a frequency f = 1/2T where T is a time length 
of the interpolation object interval. 

30. The method according to any one of claims 25 to 27, 
wherein the digital signal is a digital audio signal. 

3 1. The method according to any one of claims 25 to 27, 
wherein the digital signal is a digital image signal. 

i 32. The method according to claim 30, wherein the level 
corresponds to an amplitude value of an audio signal. 

33. The method according to claim 3 1, wherein the level 
corresponds to a gradation value of an image signal. 

34. The apparatus processing a digital signal that has a 
predetermined sampling cycle and quantization bit length, 
said apparatus comprising: 

means for sequentially detecting signal intervals, 
5 where a plurality of same levels continue; 
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means for determining a predetermined signal interval, 
including a discontinuous part between signal intervals, 
which are adjacent to each other and in which the same 
levels continue, as an interpolation object interval; 
5 means for detecting a degree of periodicity of a signal 

in a interval covering intervals before and after the 
interpolation object interval; and 

means for performing interpolation processing of 
signal levels in the interpolation object interval in 
10 accordance with a predetermined function curve, which 
monotonously changes, by adaptively changing a change 
characteristic of the function curve, on the basis of the 
degree of periodicity that is detected. 

is 35. The apparatus according to claim 34, wherein the 
interpolation means makes a characteristic of the function 
curve change so that the function curve may gently change 
when the degree of the periodicity of a signal is large, and 
the function curve may sharply change when the degree is 

20 small. 

36. The apparatus according to claim 34, wherein the 
means for performing interpolation processing operates so 
as to detect the degree of periodicity of a signal by using 
2 5 frequency analysis. 



62 



WO 01/28092 



PCT/JP00/02237 



37. The apparatus according to claim 34, wherein the 
means for performing interpolation processing operates so 
as to detect the degree of periodicity of a signal by using 
auto-correlation function analysis. 

38. The apparatus according to claim 36, comprising 
letting each of intervals where the same levels continue be 
an interpolation object interval, and the frequency analysis 
measuring a level of a frequency component at a frequency 
f = 1/2T where T is a time length of the interpolation object 
interval. 

39. The apparatus according to any one of claims 34 to 38, 
5 wherein the digital signal is a digital audio signal. 

40. The apparatus according to any one of claims 34 to 38, 
wherein the digital signal is a digital image signal. 

o 41. The apparatus according to claim 39, wherein the level 
corresponds to an amplitude value of an audio signal. 

42. The apparatus according to claim 40, wherein the level 
corresponds to a gradation value of an image signal. 

5 
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43. A method for processing a digital image signal, 
comprising the steps of: 

making gradation levels continuously change along the 
horizontal direction in the horizontal direction of a frame 
screen by performing interpolation processing in 
accordance with a predetermined function curve in a 
predetermined signal interval including a discontinuous 
part that exists between one signal interval, where the 
same gradation continue, and a signal interval, which is 
adjacent to the one signal interval and in which the same 
gradation different from them continue; and 

making gradation levels continuously change along the 
vertical direction in the vertical direction of the frame 
screen by performing interpolation processing in 
accordance with a predetermined function curve in a 
predetermined signal interval including a discontinuous 
part that exists between one signal interval, where the 
same gradation levels continue, and another signal interval, 
which is adjacent to the one signal interval and in which 
3 the same gradation levels different from them continue. 

44. The method according to claim 43, further comprising 
a step of making gradation levels continuously change 
along the interframe direction in the interframe direction 
5 by performing interpolation processing in accordance with 
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a predetermined function curve in a predetermined signal 
interval including a discontinuous part that exists between 
one signal interval, in which the same gradation levels 
continue, and another signal interval, which is adjacent to 
the one signal interval and in which the same gradation 
levels different from them continue. 

45. The method according to claim 44, further comprising 
a step of transforming a series of gradation levels in the 
horizontal direction into a series of gradation levels in the 
vertical direction after the step of performing the 
interpolation processing in the horizontal direction. 

46. The method according to claim 45, further comprising 
5 a step of transforming a series of gradation levels in the 

vertical direction into a series of gradation levels in the 
interframe direction after the step of performing the 
interpolation processing in the vertical direction. 

o 47. The method according to claim 46, further comprising 
a step of transforming a series of gradation levels in the 
interframe direction into a series of gradation levels in the 
horizontal direction after the step of performing the 
interpolation processing in the interframe direction. 

5 
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48. The method according to claim 45, 46, or 47, wherein 
the step of transforming a series of gradation levels is 
performed by reading/writing operation of frame memory. 

49. The method according to claim 48, wherein the 
reading/writing operation transforms a series of gradation 
levels by providing two image memories each having N 
frames of capacity with letting N be a natural number, and 
repeating reading and writing operations alternately. 

50. An apparatus processing a digital image signal, 
comprising: 

means for making gradation levels continuously 
change along the horizontal direction in the horizontal 
direction of a frame screen by performing interpolation 
processing in accordance with a predetermined function 
curve in a predetermined signal interval including a 
discontinuous part that exists between one signal interval, 
where the same gradation levels continue, and another 
d signal interval, which is adjacent to the one signal interval 
and in which the same gradation levels different from them 
continue; and 

means for making gradation levels continuously 
change along the vertical direction in the vertical direction 
5 of the frame screen by performing interpolation processing 
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in accordance with a predetermined function curve in a 
predetermined signal interval including a discontinuous 
part that exists between one signal interval, where the 
same gradation levels continue, and another signal interval, 
5 which is adjacent to the one signal interval and in which 
the same gradation levels different from them continue. 

51. The apparatus according to claim 50, further 
comprising means for making gradation levels continuously 

10 change along the interframe direction in the interframe 
direction by performing interpolation processing in 
accordance with a predetermined function curve in a 
predetermined signal interval including a discontinuous 
part that exists between one signal interval, where the 

is same gradation levels continue, and another signal interval, 
which is adjacent to the one signal interval and in which 
the same gradation levels different from them continue. 

52. The apparatus according to claim 51, further 
20 comprising means for changing a series of gradation levels 
in the horizontal direction into a series of gradation levels 
in the vertical direction after the step of performing the 
interpolation processing in the horizontal direction. 



67 



WO 01/28092 



PCT/JP00/02237 



53. The apparatus according to claim 52, further 
comprising means for transforming a series of gradation 
levels in the vertical direction into a series of gradation 
levels in the interframe direction after the step of 

5 performing the interpolation processing in the vertical 
direction. 

54. The apparatus according to claim 53, further 
comprising means for transforming the series of gradation 

10 levels in the interframe direction into a series of gradation 
levels in the horizontal direction after the step of 
performing the interpolation processing in the interframe 
direction. 

15 55. The apparatus according to claim 52, 53, or 54, 
wherein the means for transforming a series of gradation 
levels performs reading/ writing operation of frame memory. 

56. The apparatus according to claim 55, wherein the 
20 reading/writing operation transforms a series of gradation 
levels by providing two image memories each having N 
frames of capacity with letting N be a natural number, and 
repeating reading and writing operation alternately. 
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